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Abstract 

We propose a linear algorithm for determining two function pa- 
rameters by their linear combination. These functions must satisfy 
the first order differential equations with polynomial coefficients and 
our parameters are the coefficients of these polynomials. The algo- 
rithm consists of sequential solution by least squares method of two 
linear problems - first, differential equation polynomial coefficients 
determining for linear combination of two given functions and second 
- determining functions parameters by these polynomial coefficients. 
Numerical modeling carried by this scheme gives an good accordance 
under weak normal noise (with dispersion < 5%). 

Introduction 

In practice we often run against a problem of determining two functions 
parameters from certain classes by their linear combination. In physics prob- 
lems of that kind usually called the problems of signals, modes or rays separa- 
tion. The examples of these certain classes are exponents with polynomial ar- 
guments, harmonics functions with polynomial phase and rational functions 
0. Such problems can arise from experiment interpretation when function 
class in linear combination is derived from some theoretical consideration , 
but parameters of these functions are unknown. 
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One of the most common methods for functions parameters determining 
is the least squares method, which in general case boils down to absolute min- 
imization of the function from given class which depends on many unknown 
parameters. In linear case these problem has a simple solution - essentially, 
the linear system equation solution for given matrix. In our case, when pa- 
rameters dependence is nonlinear, this problem is sufficiently hard and does 
not have an analytical solution and so (when direct parameters search is not 
acceptable by resources conditions) the problem usually attacks with some 
step-by-step function quasilinearization (Newton's methods) . However, 
these methods has some serious faults - strong dependence on initial approx- 
imation and need for big computational resources. These conditions cannot 
be met if each function computing needs too much time or if we do not have 
good initial approximation and we are not sure in unique global minimum 
existence. 

We propose an algorithm for transformation of the above-mentioned prob- 
lem to problem of finding minimum for functionals with linear dependence 
on parameters and so we may apply the well-known methods based on linear 
systems equations solution. We restrict our attention to the case of func- 
tions satisfying the first order differential equation with polynomial coeffi- 
cients. This problem becomes linear if we shifted from function parameters 
determining to the problem of differential equations parameters determining 
(due to the fact that differential equations are linear with respect to these 
polynomial coefficients) 

The method similar to ours was developed by Kulikov for differential 
equations with constant coefficients, but in our case this method cannot 
be applied because our function does not satisfy differential equation with 
constant coefficients. 

1. The problem. 

Let fi(t), f2(t) - unknown vector- valued functions satisfying the differen- 
tial equation with polynomial coefficients : 

[D + A(t)]/i(t) = o (1) 

where 

m) = mj2p,,f (2) 

j=0 

- polynomial coefficients of degree Ni > N2 with unknown coefficients pij, 
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matrixes Mi,M2 commute (M1M2 = M2M1 ) and are given, but operators 
themselves does not equal , Pi(t) ^ P2if)- Suppose that we know the linear 
combination of these functions on interval t G [0, 1]: 

F(t) =aiA(t) + a2/2(t), (3) 

and that linear combination is bounded on this interval (sup(F(t)) < 00), 
but coefficients ai, 02 7^ are unknown. 

Our goal is to transform the problem of determining nonlinear parameters 
Pij in model function 

^mod Pij) = a-lflit; Plj) + a2f2{t] P2j) (4) 

to the sequential series of linear problems. 
2. The algorithm description. 

Main idea. Consider the problem of determining A^^i + A^2 + 2 unknown 
parameters pij for two vector-valued functions by their linear combination 
(3). From (l)-(2) we can see that unknown parameters Pij are nonlinear one 
for functions fi{t;pij). So we have a problem of determining of iVi + A''2 + 2 
unknown parameters Pij, ai, a2 by given function F{t), and only two of these 
parameters are linear for this function. 

One of most common methods for determining the unknown parameters 
by given function is the least squares method , which in our case essentially 
the minimization of deviation functional by all set of parameters 

1 

il{pij,ai,a2) = J {Fit) - F^od{t]Pij,ai,a2)fdt (5) 


where Fmod (t;pij,ai,a2) - model function (4) with given parameters de- 
pendence and F{t) - experimental function. 

Least squares method gives simple analytical solution which stable small 
errors in F{t) when all the parameters for functional @ are linear for model 
function (Q). In our case that is not so and thus direct least squares approach 
is not acceptable because of complex functional behavior and need for big 
computational resources. So we come to idea to develop a linear algorithm 
due to specific properties of our problem. 

Although our parameters Pij, ai, 02 are nonlinear for model function 
differential equations ([l|) are linear with respect to Pij and does not depend on 
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scalar factor for fi{t). Thus it makes sense to analyze differential equations 
themselves and this approach may be more constructive than direct approach. 

Formally, the problem of two functions parameters determining boils 
down to determining of the unknown coefficients pij in differential equations 
([l|) by given linear combination of unknown functions @. If the function 
d^) satisfies the differential equation L(t,pij)F^od {t'lPij) = 0, where all the 
unknown parameters are linear, then we may obtain these parameters by 
minimization of the functional: 

1 

Q{Pi,) = J {L{t,Pi,)F(t)fdt (6) 



In order to diminish the influence of numerical differentials we may in- 
tegrate our differential equation thus transform it to integral equation. By 
solving the linear problem for functional (|^) we obtain the unknown param- 
eters for functions fi{t). If these parameters are obtained, then our initial 
problem (^) is linear for remaining parameters ai,a2 and so it has an ana- 
lytical solution. 

Differential equation for sum of unknown functions. Our next goal is to 
construct a differential equation for function F{t). Our initial equation are 
homogeneous, and so differential equation for sum does not depend on 
parameters ai, a2. 

Suppose that we have an equation: 

[AD^ + BD + C]F = (7) 

Then we have: 



[AD^ + BD + C]f, = (8) 

From system we obtain a linear system for unknown functions A[t), B{t), C{t). 
If the operators Pi commute, then this system has a simple solution: 

--P2-P1 

- (Pi - P?) - iiP2 - Pi) (9) 

As far as our functions Pi{t), P2{t) are polynomials of given degrees, then 
the functions (pf) also are polynomials; for example: 
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Ni+N2 

Bk{t)= E f^kt'^k (10) 

k=0 

where (3k - new coefficients, which has exphcit dependence on parameters 
Pij, and Yk - matrixes which are exphcitly obtained from matrixes Mi,M2. 

By using differential equation (^,® for hnear combination of initial func- 
tions we may construct two-step algorithm for determining parameters 
, with each step linear. In order to do this, transform our problem to two 
linear problems. 

First step. Our ffist goal is to determine the coefficients of the polynomi- 
als A{t), B{t),C{t) under assumption that all these coefficients are indepen- 
dent. This problem is linear since all the coefficients are linear in differential 
equation (0): 

Ni N1+N2 2N1+N2 

[J2akt''XkD^+ J2 Pkt'YkD+ £ ^kt''Zk]F = (11) 

k=0 k=Q k=0 

So the problem of obtaining the coefficients ak, Pk, Jk is the linear least 
squares problem for 4iVi + 2N2 + 3 linear parameters, and we easily solve this 
problem . 

In order to diminish the numerical errors let us transform our differential 
equation (0) to integral one by integrating it two times: 

A{t)F{t) + J (b{x) - 2'-^) F{x)dx+ 

t . / - ■ ^ (12) 

+ JdxJdy (C{y) - ^ + ^) F{y)dy + L,t = L, 

This integral equation also linear with respect to parameters aki(3ki'^k, 
and all its coefficients are known functions - certain combinations of the func- 
tion F{t) and its integrals. Since all the coefficients are known and additional 
integration constants (which are also must be determined) are linear, then 
linear least squares method gives us an analytical solution. To exclude the 
trivial solution we must set one of the parameters (for example Lq) equal to 
1 and after that we may find parameters ctfc, 7^, Li by minimization of the 
functional: 
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ttfe, 7fc) = / rft fi(t)F(t) + / f - 2^) F{x)dx+ 

+ / / - ^ + ^) F{y)dy + Lit - 1 j = min 

Since this problem is linear with respect to all parameters ak, Pk,1k, Li, 
we may obtain the solution by linear least squares method. 

Second step. Our second goal is to determine the unknown coefficients 
of the initial polynomials Pi(t), P2(t) by given functions A(t), B(t), C(t). This 
problem also ca transform to the linear problem. Really, after solving the 
problem (|13D for functions A{t) , B (t) , C (t) , we have three functions: 

K^{t) = A{t) = P2-Pi 

K,{t) = B{t) + '-^ = Pi - Pi (14) 
K,{t) = C{t) = P,P,iP, - Pi) - (Pi^ - P2^) 

Under our assumptions we obtain functions Ki{t) , K2(t) , K^it) only up 
to constant factor (due to excluding of the trivial solution). So we derive 
from system ([1^ two equations which is invariant under multiplication of 
the functions Ki{t) , K2{t) , K^it) by the constant factor: 

P,{t) + P,it) = K2/K, 

Pi(t)P,(t) = [K, - {K4{K,/K^) - {K,/K,)iK,)]/K, 

From this system we can easily obtain an analytical expressions for func- 
tions Pi(t), A(t): 

Pi,2{t) = Si,2{t) (16) 
where 5'i^2(^) has explicit expression as functions of Ki{t) , K2{t) , K^it) 
due to Viet theorem (|T^: 



S,{t) + S2{t) = K2/K, 

Sr{t)S2it) = [Ks - {K,i{K2/K,) - {K2/ K,)iK,)]/ K, 



(17) 



The coefficients of these polynomials can be found from functional mini- 
mum condition: 



1 

ni{pij) = j {Pi{t-pij) - Si{t)fdt, (18) 
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where analytical expression for Pi(t;pij) are given by (|^), and Si{t) are 
determined by the first step (p!?!). 

Since our model polynomials Piit^pij) are linear with respect to pij 
and Si{t) are determined by the first step (^7\), the problem of determin- 
ing the polynomial coefficient is linear and so can be solved by linear least 
squares method [Q . Thus our algorithm transforms initial nonlinear problem 
to sequential two-step linear problem for differential equation (0) and each 
step is linear least squares problem for certain set of parameters. 

3. Modeling results. 

Our algorithm have been tested for two problems - separation of two 
overlapping Gaussian functions /j(t) = -Rj exp(— (a^t^ + Pit)), satisfying the 
differential equation 

[D-i2a,t + Pi)]f, = 0, (19) 

and separation of two vector-valued signals with linear frequency modu- 
lation 

f(+\-R ( cos{ait + [3it^) \ , . 

satisfying the differential equation 

^ n —^\' 

h = (21) 



D + {a, + 2(3,t) I ° ^ 



In the first case algorithm is valid under 10 — 15% normal noise (For 
function maximal amplitude), in the second case - under 3 — 5% normal 
noise. 

4. Discussion. 

In practice we often have the case when operators in equation (0) are not 
polynomials but a rational functions: 

m = M,'-^ , (22) 

j=0 

under assumption that Pi{t) has no singularities. 
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Such class includes rational functions, exponents and harmonic functions 
with rational argument. Our method also can be applied to that extended 
class. The reason for this is that functions Ki{t) , K2{t) , K^lt) will be also 
rational so after multiplying our differential equation (|^) by some polynomial 
we can obtain the differential equation with polynomial coefficients . Since 
determining Pi{t) by Ki{t) , K2{t) , K^lt) does not depend on constant factor 
(even if this factor is nonconstant polynomial), then the expressions ( p!6| - |T7D 
are also valid in this For determining all the coefficients we must multiply all 
the expressions by Pi(t) denominator, and set one of the coefficients qij (for 
example, under highest degree) to 1 to exclude the trivial solution: 

Npi Ngi-1 

MiY^p.jt^ - E %t^S,{t) = t^'^^S.it) (23) 

This problem also linear with respect to parameters p^j, and thus can 
be solved by linear least squares method. 
Conclusion. 

We propose an algorithm for determining parameters of two functions sat- 
isfying differential equations of the first order with polynomial coefficients by 
their linear combination. This algorithm transform initial nonlinear problem 
to sequential solving of the two linear problems - determining of polynomial 
coefficients for linear differential equation of the second order with polyno- 
mial coefficients, and determining initial polynomial coefficients from results 
or the first step. Numerical testing shows us that the algorithm is valid under 
weak normal noise (with dispersion < 5%). 
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